Experiments on logistic regression
نویسنده
چکیده
In this report, several experiments have been conducted on a spam data set with Logistic Regression based on Gradient Descent approach. First, the overfitting effect is shown with basic settings (vanilla version). Then Stochastic Gradient Descent and 2-Norm Regularization techniques are both implemented with demonstration of the benefits of these two methods in preventing overfitting. Besides, a new trick of modifying Sigmoid transfer function in the training stage is described and implemented, which is shown could help reducing overfitting as well. At last, the Label Shrinking technique is implemented. Yet, the results on this data set are not satisfying.
منابع مشابه
The Effect of Transitive Closure on the Calibration of Logistic Regression for Entity Resolution
This paper describes a series of experiments in using logistic regression machine learning as a method for entity resolution. From these experiments the authors concluded that when a supervised ML algorithm is trained to classify a pair of entity references as linked or not linked pair, the evaluation of the model’s performance should take into account the transitive closure of its pairwise lin...
متن کاملA NEW APPROACH FOR PARAMETER ESTIMATION IN FUZZY LOGISTIC REGRESSION
Logistic regression analysis is used to model categorical dependent variable. It is usually used in social sciences and clinical research. Human thoughts and disease diagnosis in clinical research contain vagueness. This situation leads researchers to combine fuzzy set and statistical theories. Fuzzy logistic regression analysis is one of the outcomes of this combination and it is used in situa...
متن کاملComparison of ordinary logistic regression and robust logistic regression models in modeling of pre-diabetes risk factors
Background: Regarding the increased risk of developing type 2 diabetes in pre-diabetic people, identifying pre-diabetes and determining of its risk factors seems so necessary. In this study, it is aimed to compare ordinary logistic regression and robust logistic regression models in modeling pre-diabetes risk factors. Methods: This is a cross-sectional study and conducted on 6460 people, over ...
متن کاملFUZZY LOGISTIC REGRESSION BASED ON LEAST SQUARE APPROACH AND TRAPEZOIDAL MEMBERSHIP FUNCTION
Logistic regression is a non-linear modification of the linearregression. The purpose of the logistic regression analysis is tomeasure the effects of multiple explanatory variables which can becontinuous and response variable is categorical. In real life there aresituations which we deal with information that is vague innature and there are cases that are not explainedprecisely. In this regard,...
متن کاملFactors Influencing Drug Injection History among Prisoners: A Comparison between Classification and Regression Trees and Logistic Regression Analysis
Background: Due to the importance of medical studies, researchers of this field should be familiar with various types of statistical analyses to select the most appropriate method based on the characteristics of their data sets. Classification and regression trees (CARTs) can be as complementary to regression models. We compared the performance of a logistic regression model and a CART in predi...
متن کاملGrowth Kinetic Survey in Direct Biological Sweetening of Natural Gas in Batch Bioreactor: Temperature Studies
The present study is focused on biodesulfurization of natural gas in a batch culture using active microorganisms. The microorganisms used for the removal of hydrogen sulfide were obtained from a hot spring. The experiments were conducted with mixed gas at operating temperatures of 25 to 45°C with a time interval of 5h. Two kinetic models included Logistic and Monod models in a batch culture wer...
متن کامل